DROPS

Document

DOI: 10.4230/LIPIcs.ECRTS.2022.2

RTScale: Sensitivity-Aware Adaptive Image Scaling for Real-Time Object Detection

Authors: Seonyeong Heo, Shinnung Jeong, and Hanjun Kim

Published in: LIPIcs, Volume 231, 34th Euromicro Conference on Real-Time Systems (ECRTS 2022)

Abstract

Real-time object detection is crucial in autonomous driving. To avoid catastrophic accidents, an autonomous car should detect objects with multiple cameras and make decisions within a certain time limit. Object detection systems can meet the real-time constraint by dynamically downsampling input images to proper scales according to their time budget. However, simply applying the same scale to all the images from multiple cameras can cause unnecessary accuracy loss because downsampling can incur a significant accuracy loss for some images. To reduce the accuracy loss while meeting the real-time constraint, this work proposes RTScale, a new adaptive real-time image scaling scheme that applies different scales to different images reflecting their sensitivities to the scaling and time budget. RTScale infers the sensitivities of multiple images from multiple cameras and determines an appropriate image scale for each image considering the real-time constraint. This work evaluates object detection accuracy and latency with RTScale for two driving datasets. The evaluation results show that RTScale can meet real-time constraints with minimal accuracy loss.

Cite as

Seonyeong Heo, Shinnung Jeong, and Hanjun Kim. RTScale: Sensitivity-Aware Adaptive Image Scaling for Real-Time Object Detection. In 34th Euromicro Conference on Real-Time Systems (ECRTS 2022). Leibniz International Proceedings in Informatics (LIPIcs), Volume 231, pp. 2:1-2:22, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2022)

Copy BibTex To Clipboard

@InProceedings{heo_et_al:LIPIcs.ECRTS.2022.2,
  author =	{Heo, Seonyeong and Jeong, Shinnung and Kim, Hanjun},
  title =	{{RTScale: Sensitivity-Aware Adaptive Image Scaling for Real-Time Object Detection}},
  booktitle =	{34th Euromicro Conference on Real-Time Systems (ECRTS 2022)},
  pages =	{2:1--2:22},
  series =	{Leibniz International Proceedings in Informatics (LIPIcs)},
  ISBN =	{978-3-95977-239-6},
  ISSN =	{1868-8969},
  year =	{2022},
  volume =	{231},
  editor =	{Maggio, Martina},
  publisher =	{Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{https://drops.dagstuhl.de/entities/document/10.4230/LIPIcs.ECRTS.2022.2},
  URN =		{urn:nbn:de:0030-drops-163199},
  doi =		{10.4230/LIPIcs.ECRTS.2022.2},
  annote =	{Keywords: Real-time object detection, Dynamic neural network execution, Adaptive image scaling, Autonomous driving, Self-driving cars}
}

Search Results

Documents authored by Kim, Hanjun

RTScale: Sensitivity-Aware Adaptive Image Scaling for Real-Time Object Detection

Abstract

Cite as

Thanks for your feedback!

Could not send message